Assessing COVID-19 vaccine effectiveness against Omicron subvariants: Report from a meeting of the World Health Organization

Emerging in November 2021, the SARS-CoV-2 Omicron variant of concern exhibited marked immune evasion resulting in reduced vaccine effectiveness against SARS-CoV-2 infection and symptomatic disease. Most vaccine effectiveness data on Omicron are derived from the first Omicron subvariant, BA.1, which caused large waves of infection in many parts of the world within a short period of time. BA.1, however, was replaced by BA.2 within months, and later by BA.4 and BA.5 (BA.4/5). These later Omicron subvariants exhibited additional mutations in the spike protein of the virus, leading to speculation that they might result in even lower vaccine effectiveness. To address this question, the World Health Organization hosted a virtual meeting on December 6, 2022, to review available evidence for vaccine effectiveness against the major Omicron subvariants up to that date. Data were presented from South Africa, the United Kingdom, the United States, and Canada, as well as the results of a review and meta-regression of studies that evaluated the duration of the vaccine effectiveness for multiple Omicron subvariants. Despite heterogeneity of results and wide confidence intervals in some studies, the majority of studies showed vaccine effectiveness tended to be lower against BA.2 and especially against BA.4/5, compared to BA.1, with perhaps faster waning against severe disease caused by BA.4/5 after a booster dose. The interpretation of these results was discussed and both immunological factors (i.e., more immune escape with BA.4/5) and methodological issues (e.g., biases related to differences in the timing of subvariant circulation) were possible explanations for the findings. COVID-19 vaccines still provide some protection against infection and symptomatic disease from all Omicron subvariants for at least several months, with greater and more durable protection against severe disease.

Assessing COVID-19 vaccine effectiveness against Omicron subvariants: Report from a meeting of the World Health Organization.

Emerging in November 2021, the SARS-CoV-2 Omicron variant of concern exhibited marked immune evasion resulting in reduced vaccine effectiveness against SARS-CoV-2 infection and symptomatic disease. Most vaccine effectiveness data on Omicron are derived from the first Omicron subvariant, BA.1, which caused large waves of infection in many parts of the world within a short period of time. BA.1, however, was replaced by BA.2 within months, and later by BA.4 and BA.5 (BA.4/5). These later Omicron subvariants exhibited additional mutations in the spike protein of the virus, leading to speculation that they might result in even lower vaccine effectiveness. To address this question, the World Health Organization hosted a virtual meeting on December 6, 2022, to review available evidence for vaccine effectiveness against the major Omicron subvariants up to that date. Data were presented from South Africa, the United Kingdom, the United States, and Canada, as well as the results of a review and meta-regression of studies that evaluated the duration of the vaccine effectiveness for multiple Omicron subvariants. Despite heterogeneity of results and wide confidence intervals in some studies, the majority of studies showed vaccine effectiveness tended to be lower against BA.2 and especially against BA.4/5, compared to BA.1, with perhaps faster waning against severe disease caused by BA.4/5 after a booster dose. The interpretation of these results was discussed and both immunological factors (i.e., more immune escape with BA.4/5) and methodological issues (e.g., biases related to differences in the timing of subvariant circulation) were possible explanations for the findings. COVID-19 vaccines still provide some protection against infection and symptomatic disease from all Omicron subvariants for at least several months, with greater and more durable protection against severe disease.

Protective effectiveness of previous SARS-CoV-2 infection and hybrid immunity against the omicron variant and severe disease: a systematic review and meta-regression.

BACKGROUND: The global surge in the omicron (B.1.1.529) variant has resulted in many individuals with hybrid immunity (immunity developed through a combination of SARS-CoV-2 infection and vaccination). We aimed to systematically review the magnitude and duration of the protective effectiveness of previous SARS-CoV-2 infection and hybrid immunity against infection and severe disease caused by the omicron variant. METHODS: For this systematic review and meta-regression, we searched for cohort, cross-sectional, and case-control studies in MEDLINE, Embase, Web of Science, ClinicalTrials.gov, the Cochrane Central Register of Controlled Trials, the WHO COVID-19 database, and Europe PubMed Central from Jan 1, 2020, to June 1, 2022, using keywords related to SARS-CoV-2, reinfection, protective effectiveness, previous infection, presence of antibodies, and hybrid immunity. The main outcomes were the protective effectiveness against reinfection and against hospital admission or severe disease of hybrid immunity, hybrid immunity relative to previous infection alone, hybrid immunity relative to previous vaccination alone, and hybrid immunity relative to hybrid immunity with fewer vaccine doses. Risk of bias was assessed with the Risk of Bias In Non-Randomized Studies of Interventions Tool. We used log-odds random-effects meta-regression to estimate the magnitude of protection at 1-month intervals. This study was registered with PROSPERO (CRD42022318605). FINDINGS: 11 studies reporting the protective effectiveness of previous SARS-CoV-2 infection and 15 studies reporting the protective effectiveness of hybrid immunity were included. For previous infection, there were 97 estimates (27 with a moderate risk of bias and 70 with a serious risk of bias). The effectiveness of previous infection against hospital admission or severe disease was 74·6% (95% CI 63·1-83·5) at 12 months. The effectiveness of previous infection against reinfection waned to 24·7% (95% CI 16·4-35·5) at 12 months. For hybrid immunity, there were 153 estimates (78 with a moderate risk of bias and 75 with a serious risk of bias). The effectiveness of hybrid immunity against hospital admission or severe disease was 97·4% (95% CI 91·4-99·2) at 12 months with primary series vaccination and 95·3% (81·9-98·9) at 6 months with the first booster vaccination after the most recent infection or vaccination. Against reinfection, the effectiveness of hybrid immunity following primary series vaccination waned to 41·8% (95% CI 31·5-52·8) at 12 months, while the effectiveness of hybrid immunity following first booster vaccination waned to 46·5% (36·0-57·3) at 6 months. INTERPRETATION: All estimates of protection waned within months against reinfection but remained high and sustained for hospital admission or severe disease. Individuals with hybrid immunity had the highest magnitude and durability of protection, and as a result might be able to extend the period before booster vaccinations are needed compared to individuals who have never been infected. FUNDING: WHO COVID-19 Solidarity Response Fund and the Coalition for Epidemic Preparedness Innovations.

A Systematic Review of Coronavirus Disease 2019 Vaccine Efficacy and Effectiveness Against Severe Acute Respiratory Syndrome Coronavirus 2 Infection and Disease.

Billions of doses of coronavirus disease 2019 (COVID-19) vaccines have been administered globally, dramatically reducing severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) incidence and severity in some settings. Many studies suggest vaccines provide a high degree of protection against infection and disease, but precise estimates vary and studies differ in design, outcomes measured, dosing regime, location, and circulating virus strains. In this study, we conduct a systematic review of COVID-19 vaccines through February 2022. We included efficacy data from Phase 3 clinical trials for 15 vaccines undergoing World Health Organization Emergency Use Listing evaluation and real-world effectiveness for 8 vaccines with observational studies meeting inclusion criteria. Vaccine metrics collected include protection against asymptomatic infection, any infection, symptomatic COVID-19, and severe outcomes including hospitalization and death, for partial or complete vaccination, and against variants of concern Alpha, Beta, Gamma, Delta, and Omicron. We additionally review the epidemiological principles behind the design and interpretation of vaccine efficacy and effectiveness studies, including important sources of heterogeneity.

A systematic review of COVID-19 vaccine efficacy and effectiveness against SARS-CoV-2 infection and disease

Billions of doses of COVID-19 vaccines have been administered globally, dramatically reducing SARS-CoV-2 incidence and severity in some settings. Many studies suggest vaccines provide a high degree of protection against infection and disease, but precise estimates vary and studies differ in design, outcomes measured, dosing regime, location, and circulating virus strains. Here we conduct a systematic review of COVID-19 vaccines through February 2022. We included efficacy data from Phase 3 clinical trials for 15 vaccines undergoing WHO Emergency Use Listing evaluation and real-world effectiveness for 8 vaccines with observational studies meeting inclusion criteria. Vaccine metrics collected include protection against asymptomatic infection, any infection, symptomatic COVID-19, and severe outcomes including hospitalization and death, for partial or complete vaccination, and against variants of concern Alpha, Beta, Gamma, Delta, and Omicron. We additionally review the epidemiological principles behind the design and interpretation of vaccine efficacy and effectiveness studies, including important sources of heterogeneity.

Assessing vaccine effectiveness against severe COVID-19 disease caused by omicron variant. Report from a meeting of the World Health Organization.

Vaccine effectiveness is lower and wanes faster against infection and symptomatic disease caused by the omicron variant of SARS-CoV-2 than was observed with previous variants. Vaccine effectiveness against severe omicron disease, on average, is higher, but has shown variability, including rapid apparent waning, in some studies. Assessing vaccine effectiveness against omicron severe disease using hospital admission as a measure of severe disease has become more challenging because of omicron's attenuated intrinsic severity and its high prevalence of infection. Many hospital admissions likely occur among people with incidental omicron infection or among those with infection-induced exacerbation of chronic medical conditions. To address this challenge, the World Health Organization held a virtual meeting on March 15, 2022, to review evidence from several studies that assessed Covid-19 vaccine effectiveness against severe omicron disease using several outcome definitions. Data was shown from studies in South Africa, the United States, the United Kingdom and Qatar. Several approaches were proposed that better characterize vaccine protection against severe Covid-19 disease caused by the omicron variant than using hospitalization of omicron-infected persons to define severe disease. Using more specific definitions for severe respiratory Covid-19 disease, such as indicators of respiratory distress (e.g. oxygen requirement, mechanical ventilation, and ICU admission), showed higher vaccine effectiveness than against hospital admission. Second, vaccine effectiveness against progression from omicron infection to hospitalization, or severe disease, also showed higher vaccine protection. These approaches might better characterize vaccine performance against severe Covid-19 disease caused by omicron, as well as future variants that evade humoral immunity, than using hospitalization with omicron infection as an indicator of severe disease.

Duration of effectiveness of vaccines against SARS-CoV-2 infection and COVID-19 disease: results of a systematic review and meta-regression.

BACKGROUND: Knowing whether COVID-19 vaccine effectiveness wanes is crucial for informing vaccine policy, such as the need for and timing of booster doses. We aimed to systematically review the evidence for the duration of protection of COVID-19 vaccines against various clinical outcomes, and to assess changes in the rates of breakthrough infection caused by the delta variant with increasing time since vaccination. METHODS: This study was designed as a systematic review and meta-regression. We did a systematic review of preprint and peer-reviewed published article databases from June 17, 2021, to Dec 2, 2021. Randomised controlled trials of COVID-19 vaccine efficacy and observational studies of COVID-19 vaccine effectiveness were eligible. Studies with vaccine efficacy or effectiveness estimates at discrete time intervals of people who had received full vaccination and that met predefined screening criteria underwent full-text review. We used random-effects meta-regression to estimate the average change in vaccine efficacy or effectiveness 1-6 months after full vaccination. FINDINGS: Of 13 744 studies screened, 310 underwent full-text review, and 18 studies were included (all studies were carried out before the omicron variant began to circulate widely). Risk of bias, established using the risk of bias 2 tool for randomised controlled trials or the risk of bias in non-randomised studies of interventions tool was low for three studies, moderate for eight studies, and serious for seven studies. We included 78 vaccine-specific vaccine efficacy or effectiveness evaluations (Pfizer-BioNTech-Comirnaty, n=38; Moderna-mRNA-1273, n=23; Janssen-Ad26.COV2.S, n=9; and AstraZeneca-Vaxzevria, n=8). On average, vaccine efficacy or effectiveness against SARS-CoV-2 infection decreased from 1 month to 6 months after full vaccination by 21·0 percentage points (95% CI 13·9-29·8) among people of all ages and 20·7 percentage points (10·2-36·6) among older people (as defined by each study, who were at least 50 years old). For symptomatic COVID-19 disease, vaccine efficacy or effectiveness decreased by 24·9 percentage points (95% CI 13·4-41·6) in people of all ages and 32·0 percentage points (11·0-69·0) in older people. For severe COVID-19 disease, vaccine efficacy or effectiveness decreased by 10·0 percentage points (95% CI 6·1-15·4) in people of all ages and 9·5 percentage points (5·7-14·6) in older people. Most (81%) vaccine efficacy or effectiveness estimates against severe disease remained greater than 70% over time. INTERPRETATION: COVID-19 vaccine efficacy or effectiveness against severe disease remained high, although it did decrease somewhat by 6 months after full vaccination. By contrast, vaccine efficacy or effectiveness against infection and symptomatic disease decreased approximately 20-30 percentage points by 6 months. The decrease in vaccine efficacy or effectiveness is likely caused by, at least in part, waning immunity, although an effect of bias cannot be ruled out. Evaluating vaccine efficacy or effectiveness beyond 6 months will be crucial for updating COVID-19 vaccine policy. FUNDING: Coalition for Epidemic Preparedness Innovations.

Evaluation of post-introduction COVID-19 vaccine effectiveness: Summary of interim guidance of the World Health Organization.

Phase 3 randomized-controlled trials have provided promising results of COVID-19 vaccine efficacy, ranging from 50 to 95% against symptomatic disease as the primary endpoints, resulting in emergency use authorization/listing for several vaccines. However, given the short duration of follow-up during the clinical trials, strict eligibility criteria, emerging variants of concern, and the changing epidemiology of the pandemic, many questions still remain unanswered regarding vaccine performance. Post-introduction vaccine effectiveness evaluations can help us to understand the vaccine's effect on reducing infection and disease when used in real-world conditions. They can also address important questions that were either not studied or were incompletely studied in the trials and that will inform evolving vaccine policy, including assessment of the duration of effectiveness; effectiveness in key subpopulations, such as the very old or immunocompromised; against severe disease and death due to COVID-19; against emerging SARS-CoV-2 variants of concern; and with different vaccination schedules, such as number of doses and varying dosing intervals. WHO convened an expert panel to develop interim best practice guidance for COVID-19 vaccine effectiveness evaluations. We present a summary of the interim guidance, including discussion of different study designs, priority outcomes to evaluate, potential biases, existing surveillance platforms that can be used, and recommendations for reporting results.